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The San Mateo Educational Resources Center has, since 1969, been 
operating an educational information and dissemination center, providing 
RIE, CUE, periodical, book, and locally collected fugitive materials 
for educators within San Kateo County and other counties, institutions, 
professional associations, and similar agencies throughout California 
and the Western region. In 1971, USOE (and latterly, NIE) granted funds 
to SMERC to develop satellite information centers in the Northern, 
Southern, and Central Valley regions of California; to improve the ac- 
quisitions program of the Center; to inprove search services to clientele 
primarily through developing computer access to P.IE and CUE; and to 
develop bases for continuing evaluation of the Center's services. In 
addition, a small grant was made for purposes of training others in 
information service operation^. 

As a result of this grant, S^^ERC is to ser^e as a model for other 
states and regions wishing to establish educational information systems, 
particularly those who vish to consider UL5ing a framework or system 
including a "super-center"., with responsibilities for major acquisitions, 
microfilming, publications, the majority of search processing, and train- 
ing; and satellite center-:, with responsibilities for district negotiations 
and a limited collection aud search capacity. Such a system enables a 
single major collection to be used to serve both a wide geographic region 
and a diversity of clientele, and seems particularly effective in serving 
educational practitioners* 

This is the final report of the California Integrated Network of 
Educational Information Services Project, as the grant was referred to in 
its original proposal. As such it covers activities from July 1, 1971 to 
June 30, 1973. 
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GENERAL DESCRIPTION OF THE PROJECT 



The San Mateo Educational Resources Center (SMERC)-'" has, since 1969, 
been operating an educational infonration and dissemination center, 
providing RIE, CIJE, periodical, book, and locally collected fugitive 
materials for educators within San Mateo County and other counties, 
institutions, professional associations, and similar agencies throughout 
California and the VJestem region. In 1971, USOE (and latterly, NIE) 
granted funds to SMEIRC to develop satellite information centers in the 
Northern, Southern, and Central Valley regions of California; to improve 
the acquisitions program of the Center; to improve search services to 
clientele primarily through developing coTnputer access to RIE and CIJE; 
and to develop bases for continuing evaluation of the Center *s services* 
In addition, a snail grant was Jiede for purposes of trciining others in 
infonration service operation. 

As a result of this grant, SMERC is to serve as a model for other 
states and regions wishing to establish educational information systems, 
particularly those v?ho iv^sh to consider using a framc'.7ork or system 
including a "super-center", with responsibilities for iiajor. acquisitions, 
microfilming, publications, the majority of search processing, and train- 
ing; and satellite centers, V7ith responsibilities for direct negotiations 
and a limited collection and search capacity. Such a system enables a 
single major collection to be used to serve both a wide geographic region 
and a diversity of clientele, and seems particularly effective in serving 
educational practiLioners. 

This is the final report of the California Integrated Network of 
Educational Informtion Services Project, as the grant was referred to in 
its original proposal. As such, it covers activities from July 1, 1971 to 
June 30, 1973. During thi.s period, major SMERC accom.plishments included 
the follov7ing: 



In the original proposal and grant, the information service vns referred 
to as the Bay Area Infonration Center (BAIC). Since that time, the Center 
has been entitled, and became conmonly known as, the San Vlateo Educational 
Resources Center (SI'IERC) and v;ill be referred to by the latter title 
througl-iout this report. 
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12,851 searches were completed for clients j of vMch 6 ,566 were 

requests for specific documents, i;739 were requests for ccffnputer 
searches of RIE and CIJE indexed documents, and 4,896 were requests 
for in-depth searches coverivig R2'E, CIJE, fugitive materials, special 
files and library references. 

13 Resource Guides/Bibliographies and 5 Newsletters were published 

and distributed to clientele (See Appendix A for a list of titles of 
these publications). An average of 6,330 copies of each of these 
publications were printed and distributed. 

85 presentations to client groups concerning S^ERC services 

available to them were irade, the majority of which v;ere held at the 
clients * location . 

8 training sessions in information management, the negotiations 

process, and similar concerns were held. A total of 120 pe??sons, most 
of whom are serving as linking agents between clientele and tJie 
information system, attended these sessions. 

The data bank available for searching for SMERC clientele increased 

from approximately 90,163 documents to approximately 148,261 documents, 
including all of RIE, a major part of CIJE, SMERC 's own FIDO (Fugitive 
Information Data Organizer), and other special collect 5.ons . 

The number of agencies contracting for searx^h ser.'vices with SMERC 

increased from 11 to 37. 

The number of persons employed on a full time equivalent basis by 

SMERC to service its clientele increased from 10 to 22 1/2. 

The major search strategy used by SMERC staiT changed from reliance 

on hand-searching of RIE, CIJE, and FIDO catalogues, to a continually 
increasing reliance on computer searches utiliz:Lng Lockheed Corporation's 
DIALOG program. 

Of course all of the activity and growth 5xidicated by the ria.ta 
presented above cannot be attributed to the California Integrated Network 
of Information Services Project. Specific activities within the project 
are described in the stibsequent section of this report. HDv;ever, the 
added impetus given to the total inf emotion system operation by this 
project extended ixi intangible ways beyond these particular actitivies. 
It will be missed! 
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SUMMARY OF ACTIVITIES, JULY 1, 1971 to JUNE 30, 1973 



THiB following sujimary is based on the objectives appearing in the 
original application for Research Support dated April 22, 1971, and the 
restatement of these objectives in the Request for a 6-Tnon1h Ebctension 
submitted on November 14- , 1972. The numeration of the objectives vodll 
be tMt used in the latter application. The statements of the objectives 
are slightly reworded in order to include both original and "extension" 
objectives* 

Objective 1.0 

To develop and give operational support to a regional resource 
center in the Southern California Region in such a way that this center 
(hereafter referred to as Southern California Area Inforrration Network, 
or SCAIlO can t>ecome a self-supporting satellite of SMERC by July 1, 1973. 

Activities and Results 

1.1 SCAIN began operation under the aegis of Wnittier College, 
Whittier, California, in September, 1971. Point-to-point communication 
between SCAIN and ST-IERC was established shortly thereafter. 

1.2 ApproxiriHtely 6S8 requests for infomration were received and 
negotiated by SCAIII and processed by SMERC during the project period. 

1.3 All SCAIN personnel involved in the negotiation of searches ^ 
and operation of the SCAIN satellite v;ere trained by S^IERC as linking 
agents. SCAIN personnel participated in 5 different workshops held at 
SMERC for this purpose. 

1.1+ On 14 separate occasion?, SMERC staff provided presentations 
concerning SI-EERC-SCAIN services and infomation usage to clientele v/ithin 
the SCAIN service area. 

1.5 Financial support for SCAIN was provided according to the 
budgets suhndrt'ed with the California Integrated Network of Inforrnation 
Services Project application and "tiievRequest for Ebdzension* 



1.6 During the period December ^972 to I^y 1973,, a total of 3K6 
searches were negotiated and completed for SCAIN clientele. During the 
same period of 1971-72, a total of 120 searches were completed. This 
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(approximately) 3 to 1 increase in number of searches involved a similar 
increase in the use of point-to-point commanication between the satellite 
and SMERC. 

1.7 Management support and planning assistance v;ere provided to 
SCATM by SMEIRC staff, particularly Dr. Prank Mattas, Director, continually 
during the project period. This assistance was provided by telephone, and 
by trips either by Dr. John Dean (Director of SCAIN) and other SCAIN staff 
to Redwood City, or by Dr. Mattas to Whittier. For exainple, d-uring the 
period of the extension of the project, at least 10 telephone conferences 
were held, and 3 planning meetings were held at SCAIN involving personnel 
of both agencies. 

1.8 At the time of the preparation of this report, negotiations are 
underway with potential client agencies for SCAIN, particularly v/ith the 
Orange County Superintendent of Schools and Kern County Superintendent 

of Schools. l*Jhether or not SCAH^I will be able to operate on a self- 
supporting basis during FY 1973 depends upon the success of these 
negotiations. 

Objective 2,0 

To cooperate v;it}i the State Department of Education in planning 
activities for the development and improvement of statewide information 
system operations. 

Activities ond Results 

1.0 During the first 18 months of the project a number of meetings ^ 
contacts, and discussions were held with various State Department 
officials concerning the developnent of educational information systems. 
However, v£irious decisions and priorities in the State Department, 
particularly the concern vri.th major reorganization and changes in personnel, 
led that agency to give a relatively low priority to infonTa.tion system 
development, in spite of considerable interest on the part of individuals 
in the Department. In the Fall of 1972, vxyrd that NIE was becoming 
strongly interested in establishing Field Agent activities in SEA^s 
brought renev/ed interest at the state level, and 2 meetings were held 
with Dr* E^vid Evans of the Bureau of Planning and Development concerning 



SMERC-State Department cooperation. As a result of ti'iese meetings, 
David E. Rawnsley, Consultant to SMERC, prepared and sialxnitted a brief 
plan for services which SMERC rnight provide to the State Department. 
(Tliese plans are ixicluded in tliis report as Appendix B). However, no 
action has been taJcen at the State level at the time of this report on 
either 'these plans or other ideas for further development of a state-wide 
information system. 

2.2 In late June, 1973, St^IERC was contacted by the staff of the State 
Senate Select Conmittee on Innovation and Change in the Administration 
and Structure of Public Education. The CorrimittGe expressed interest in the 
state of information systems in California and nationally, and in several 
other areas connected v/ith innovation and change in education and the 
evaluation of such changes. SIIERC has and will continue to cooperate with 
this Conimittee and other agencies at the state level in order to assist 
in the development of statev;ide information systems. 

Objective 3.0 

To support the State Department of Education in the development of 
needed satellite centers, particularly in Northern California, and to 
continue to support such satellites after their establishment. 

Activities and Results 

3.1 In lieu of State Department activity in this field (see 
Objective 2.0), SMEI<C assumed the initiative in developing satellite 
centers in Morthern California, tluough the Northern California Planning 
and Development Center, Chico, and the Central Valley, thirough the Office 
of the Superintendent of Schools of Tulare County, Visalia. Both of these 
Centers are presently in oper\ation. 

3.2 Point-to-point connunication was established v;ith both of these 
satellites. 

3.3 Since their establishment, a total of 1,559 searches have been 
received and negotiated by these centers, and processed by SMERC Cof the 
total, approxinB^tely 2/3rds were originated by clients of the Northern 
California Center), 

3.4 Site visitations by SMERC staff vjere made 18 times in these 
satellite's service areas for the purpose of introducing clientele to 



the services being offtsred, and training clientele in their use. 

3.5 All personnel of both satellites have been trained by SMERC 
staff in negotiation processes and infoniHtion Jianage?nent . 

3.6 Di-ring the period of 1 January, 1973 and May 30, 1973, a total 
of 273 searches were completed for clientele of these satellites » For a 
similar period of 1972, the total was 220. A comparable increase was 
mde in the time used for point-to-point corrimunication. 

Objective k.O 

To continue to expand SMERC 's collection, including ERIC materials, 
fugitive naterials, and other special collections. 

Activities and Results 

4.1 Approdjrately 7,000 documents have been accessioned into FIDO 
(Fugitive Informtion Data Organizer) during the project period. Accession- 
ing includes assigning descriptors to the documents, indexing and generating 
catalogues and putting the documents into microform. 

Investigation has also been made of the feasibility, desirability, 
and costs of providing couputer indexing and accessibility for the Fugitive 
Infomation Data Orgcinizer. This study,, in , the form of a proposal, was 
submitlred to lUE during the Spring of 1973, and appears as Appendix C, 
However, lack of sufficient funds has rrade it necessary to put this project 
into abeyance ror the time being. 

In order to be prep^ed for placing FIDO indices into the computer, 
it has becor.e the practice at S^C to write sunmaries or '*mini-abs tracts" 
for all docun;ents being accessioned into FIDO. 

U.2 All ERIC documents and indices produced during the project 
period have been acquired by S^ERC. The St'lERC collection of journals 
cited in either CIJE or Education Index has expanded to 700 titles, axxi 
an effort has been undervjay to assure that all titles include issues of 
each journal since 1969. 

r 

4.3 In addition to RIE, CIJE, and FIDO, the SMERC system also 
includes: 
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Se'arch access to the MnS through .the DIALOG system. 

Special collections of UNIPAC?, Learning Centers, and perfonnance 

objectives. 

A staf f-<3eveloped cross-indexing of ERIC numerations and the AIMS 

and ARMS collections, in order to increase access to these collections. 

Participation in studying the feasibility of establishing a library 

network which would include public, university, and industrial/technical 
Libraries. 

Objective 5>0 

To provide rapid and effective information services to educators 
and education decision^makers who are clients of SMERC and its satellites, 
and where appropriate, to ijnprove the efficiency of the services. 

Activities ard Results 

$•1 Access to Lockheed Corporation's DIALOG computer program was 
completed, and all appropriate SMERC staff have been and continue to be 
trained in its use. Training includes periodic training sessions with 
Lockheed personnel to increase effective use of the system, and circulation 
to all staff of the DIALOG newsnotes. Since access to DIALOG was established, 
an approxirate total of 5,330 searches have been processed for SMERC, using 
a total of approxiirately 1,200 hours of computer time. DIADDG data indicates 
that SMERC is the most active user of the system. 

5.2 Preparations have been made to increase efficient access to FIDO 
(see U.l above). 

5.3 The service area of SMERC has 'extended from the 11 agencies 
being served at the time of the original proposril for thic- project 
(April, 1971) to a total of 37 counties, regions, institutions, and pro- 
fessional associations presently being served. 

Objective 6.0 

To provide training of staff, linking agents, and clientele in order 
to assure the effective use of SffiRC and related resources. 

Activities and Results 

6.1 During the Fall of 1972, a schedule of meetings was established 
for staff training in areas of educational content, search techniques, and 
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internal HHmagement . Although this schedul^e was sometijnes compromised by 
events (such as the irove of SMERC into new facilities in Fehruary, 1973), 
such Jneetings xvere held approximately every two weeks • Training was done 
by SMERC staff, DIALOG personnel (see 5.1 above), and on occasion by 
personnel from such agencies as the ERIC Clearinghouse on Media and 
Technology, Stanford Univarsit;^;. 

6*2 A total of 8 training sessions were held for persons assuming 
the role of linking agents for the client agencies and satellites of SMERC. 
About 120 people attended these sessions, which were generally of 2 or 3 
days duration. These sessions t^-'pically included introduction to the role 
of ^Jiformtion systems in education, familiarization with ERIC and the SMERC 
collection, and intensive training in the search negotiation process and 
linking agent functions* Training was done prinarily through role-playing 
and acl-ually performing searches. 

6.3 A^ an addendum to the California Network of Educational 
Information Services Project, SMERC contracted vath NIE to peform linking 
agent emd infonration management training for persons designated by NIE. 
A report of the tradjiing undertaken undei^ this contract, including 
evaluation of the activity, is included as an addendum to thi.s report, 
beginning on page 15. 

6.4 A total of 85 presentations, seminars, and similar programs have 
been held to familiarize clientele and potential clientele with the services 
available from SI-IERC. The uajority of these presentations were given to 
staffs of individual schools. All but a small number of these activities 
have taken place in client institutions. A multimedia presentation 
describing EPJC and SMERC was developed for use at such presentations. 

6.5 A total of 50,000 brochures describing SMERC services and how to 
use them were distributed in various ways to clientele. In addition, 

all other publications of the Center (see Objective 8.0 below) include 
such descriptive materials about the Center and how a client can submit 
a search or order documents. 

Objective 7.0 

To establish the management of SMERC on a rranagement by objectives/ 
results basis. 
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Activities and Results 

7*1 As a first step toWcird adiieving this objective, objectives 
stated in perfonnance terms for the major functions of the Center were 
developed during the Winter of 1972-73. A major concern in the develop- 
ment of these objectives was to provide a basis for assessing the degree 
to which each of the inajor function were being accomplished successfully • 

Objective 8.0 

To develop, publish, and distribute to clientele News Motes, 
bibliographies, resource guides, and catalogues* 

Activities and Results 

8.1 During the period June, 1972 to June, 1973, 18 bibliographies, 
resource guides and catalogues were published. In addition, 5 editions 
of News Notes were published. All of these publications were distributed 
to clientele in a quantity at least equal to the number of schools being 
served by the contracting county or other agency. Note: Funds from the 
California Integrated Network of Educational Infomation Services Project 
did^ not cover the cost of preparation and distribution of these publica- 
tions except for those distributed to the satellites included in the 
project. (See Appendix A for titles.) 

Objective 9.0 

To systematically evaluate the effectiveness of system services. 

Activities and Results 

9.1 Reference to the measurable objectives developed for SMERC 
operations was nade in 7.1 above. These objectives are included as 
Appendix D. For those objectives which require input from. clientele, 
restrictions on time and resources, particulary given the najor move 
from one facility to another, made it impossible to undertake this form 
of evaluation during this fiscal year. 

As both an assessment of the services provided under contract with 
the Arizona Educational Infornation System, Ari2X)na State University, 
Tempe, and as a pilot test of assessment methods to be applied next year, 
a small scale study was done with a sample of Arizona clientele • 

o g 
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Apparopriate parts of the report of that assessment (excluding considerations 
of personnel perfornmnce) are included in this report as Appendix E, 

9,2 A system for documentation of the activities of SMERC in reference 
to searches completed, types of search strategies used^ total microfiche 
produced, and related mattes was established in Septeinber, 1971, The. results 
of this documentation, V7hich ^is used ixDth for long-range assessment and for 
short-range planning and policy development, are included in tabular and 
graphic fom in Appendix F. Examination of this data leads the Center to 
the follov7ing conclusions, cJuong others. 

The large increase in the number of searches completed, particularly 

during FY 1972-73, is due more to an increase in the number of agencies 
contractit^ig vjith SI-ERC rather than significant increases in the number of 
individuals v;ithin a contracting agency who are mEaking search requests. 
VJhile still continuing its efforts to make inforration services available 
to more clientele in. the Western region, a rrajor effort will be mde during 
FY 1973-74- to increase the number of individuals witliin existing conti^acts 
v;ho request searches. 

^ — Ihere has been a significant shift away from in-depth searches (i.e. 

searches in v^hich the Research Assistant makes judgments concerning the 
relevance of docur^ents to the search request, ax)d responds to the request 
by sending full copies of only those dociiments which appear to be most 
relevant) to responding to searches by sendijig the requester a comj^uter 
print --out of" abslTacts of all docum.ents cite-d by tlie computer as a result 
of the search logic used. This shift has implications both in terms of 
the cost of searches (after a cer^tain cutoff point, v;hich has not been 
determined as yet, using the computer print -HDut becomies more expensive than 
sending a limited number of specific documents) and in terms of client 
satisfaction. VJe do not knov? as yet vjhether clients prefer one type of 
response to another, although there is reason to believe that preferences 
vary with the role (teacher, administrator, researcher, etc.) of th-^. 
requester, 

There has been, and continues to be, an increase in the niamiber of 

searches v;hich are requests for specific docum.ents in microfiche foni^t. 
Some of this increase can be attributed to the fact that certain of the 
satellites and other contracting agencies have the capabilities of doing 
certain searches themselves, in which cases SMERC 's role is limited to 
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reproduction of the documents uncovered in the seaapch, • An undetermined 
amount of the increase in requests 'for specific microfiche is also due 
to the increase in the number of computer print-outs being sent in 
response to search requests as described alx>ve. In this case the client 
follows up the original search with an order for specific fiche he/she 
has selected from the prijit-out. An effort was made durijig the Spring 
of 1973 to determine to what degree such use was being nade of print- 
outs 5 but the data collected (by including a special order form with the 
print-out) appeared to be too unreliable to be of much use. 

However, the n\ajor reason for such increase in requests for specific 
microfiche would appear to be a result of the publication program of 
SMERC briefly described under Objective 8.0 above. This is particularly 
true of the bibliographies/resource guides. The success of this program 
i'lot only h^is assured its continuance and if possible its enlargement , 
but has also led SI-ERC staff to investigate other formats for providing 
clientele V7ith the opportunity to in effect do their ovjn searches. 

r-'Z-JOR OUTCOMES OF lliE PROJECT 



Although the budget of the California Integrated Net;%ork of 
Educational Inforrr«£ition Services Project represented only a relatively 
snail propor^tion of the total operatirig budget of the San Mateo 
Educational Resources Canter, its direct and indirect effects on the 
Center.'^ v;ere great. VJhile not all of -the major changes summarized below 
can be directly attributed to the Project, it is doubtful if any of them 
could have occurred v;ithout the added impetus given by the Project. 

The establisl'iment of access to the DIALOG- system eind the training 

of SMERC staff in its use not only increased the effectiveness with 
v;hich staff could meet information needs of clientele, but also enabled 
the Center to offer its services to a much broader range of client, both 
geographically and in role. V/ithout on-line access to DIALOG, it is 
very doubtful that the number of searches done could have been handled 
without increasing staff beyond the point of feasibility in terms of 
cost to client agencies. 
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The establishment of the three satellite centers, .and the e':5>ansion 

of the geographic areei served to Arizona, through the Arizona Educational 
Infonnation Sjrstem, wliich in reference to providing access to ERIC and 
similar information files is in effect a satellite. These Centers (and 
in particular the Center in Northern California) provide a test of the 
model of infometion services which includes a "super-center" or 
infornation broker serving satellites which theinselves are capable of 
providing limitfxi services to clientele, including (as in the case of the 
Northern CaJLifcrnia Center) staff whose function is strongly amlogous to 
that of a field agent. Up to this date, the test of the model has proven 
successful. 

Establisliing the basis, through the developrient of objectives, 

functional cJ^alysis, and documentation, for assessing the effectiveness 
of the total service and its constituent parts. The tremendous grovTth 
of SJCRC during the lant tv;o years, wliile certainly not haphazard, lias 
not allov:ed for the time to be taken by staff to analyze trends in. search 
demands and related rrn'tters to see v;hat changes, if any, are needed in tivC: 
system in order to more efficiently meet information needs of clientele. 
The activities under Objectives 7.0 arrl 9,0 cited above v.dll enable the 
management of the system to undertake continual analysis of the total- 
operation based on specific data. 

Providing training of lirfcing agents and clientele, both through 

traini'jig sessions or preGentations £ind through publications. The 
effectiveness of an information system depends as much if not more on 
the abilit^^ of its clientele to use the system as on its internal 
operation and collection. During the last tx-K) years SMERC has developed 
a cadi'e of staff, and related materials and motliods, to do an effective 
job of training linkin,g agents. That this is so is indicated by the 
evaluation of the training session described in the adderrium to this 
report beginnL^ on page 15. Through such training, a wide range of 
personnel in the satellites and othei** contracting agencies (including 
those with backgroLinds ranging from secretarial training to advanced 
degrees in education and library sciences) have become proficient as 
linking agents, and are well able to perform this most important role in 
the total information system. 

12 
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The training of clientele to become habitual and informed users of 
the system is less easy to evaluate. That the presentations made are 
effective seeiTiS to be indicated by the fact that search demands sharply 
increase in a given area after a presentation is mde. But that these 
presentations are not as effective as might be hoped in ireking system 
use habitual, is indicated by the fact that search demands drop off fairly 
rapidly in many cases within tv:o or three months after such a presentation. 
Having SMERC staff irake presentations in every region every two or three 
months i.*::. not an economically feasible way of maintaining increased search 
demands. An alternative v:hJ.ch has been f-Ucccssful in somiC contracts is 
for either the linking agent or some othar person on the staff of the 
contacting agency serve the function of Field Agent, at least in reference 
to information system activities. SMERC plans to investigate v;hat types 
of training and other support mlgiit be necessary to spread this practice 
to all contracting agencies. 

Tb'ire are three areas in v/hich results over the project period v;ere 
less satisfactory tiian anticipated: 

In spite of contir'.i';:;d efforts on the part of SMEiC, the State 

Department of Education /las not become active in the field of information 
systems, nor has the department entered into any close cooperative efforts 
with Si^C. 

Search load has not increased as expected from the Central Valley 

satellite, and the activities of ths SC/^Jl^I satellite have not expanded 
at the rate hoped for. The forTner situation appears to be due to a change 
in personnel, vdth a resultant slackening in the clicn-:-centered activities 
of the linking agent. It is hoped that sane planned activities in the 
Fall will reverse the trend. In the latter situation it vxDuld appear that, 
in spite of strong efforts on the part of SCAIInI personiiel, the selection 
of a private college as the ad.Tiinistrator for the satellite has made it 
more difficult for SCAIN to develop relationships with a number of 
potential clientele, particularly those serving large numbers of students. 
This conment is in no way meant to be a criticism of either SCAIN personnel 
or VJhittiej:^ College. Rather it is an oberservation concemiPig the perceived 
viability of a satellite on the pcrc: of potential clientele, particularly 
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those whose size leads them to see such functions as infonration services 
as being rn^re appropriately theirs: 

Due to financial limitations, FIDO ca.talogues have not been put into 

the computer, therefore making hand-- searching for documents in this 
collection necessary^ An unsolicited proposal for assistance in furding 
this project was submitted to ERIC Central. See Appendix C. 

With the exception of these three items, all of the objectives of the 
original proposal and i^equest for extension for the California Integrated 
Network of Educational Infonration Services have been met. To a leirge 
degree due to the activities V7hich SMERC was able to undertake under this 
project, SMEPvC is now the largest educational infonration system directly 
serving practicing clientele, and is operating in such a way that it can 
and does continually search for nev7 y^:ays to serve educators throughout 
the V;est. 
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ADDENDUM: REPORT OF THE TRAINING SESSION HELD L'fNDER AN ADDENDUM TO THE 
REQUEST FOR EJOENSION OF THE CAlIFdRNIA INTEGRATED SYSTEM OF EDUCATIONAL 
INFORMATION SERVICES. 

In an addendum to the grant for extension of the Neterork Project, 
SMERC was granted funds to perform training of linkirg agents and 
inforT.nation system mnsgers, to be named by NIE. Such training was held 
from June 25 to June 29, 1973 in the SMERC facilities in Redvjood City, 
California. Invitations to participate were sent to SEA's throughout the 
United States by IJIE request, and, in order to fill the sessions, to new 
contracting agencies vTithin the Si-IERC service area.-. The irajority of the 
participants fell into the latter category. Training in general follov:ed 
the guide developed cooperatively by Stanford University and SDC Corporation, 
V7ith a number of variations made by St-ERC staff in order to fit the particular 
needs of the trainees, and in order to maximize the effectiveness of having 
the training occur in an operating Center. 

Evalutation of the training program was done in four v;ays: 

1. All major activities v.athin the program were evaluated using 
the rating form developed by Stanford-SDC, a copy of which 
is attached on page 33. 

2. Overall comments about the program were elicited from 
participants. 

' 3. A subsample of participants v:ere asked to iiake v;ritten 
comments about one of the trainirig sessions (The field 
t-rip to LocJdieed Computer Center). 

4. For one field trip activity, participants were asked to 
conment on the trip, rather than using the rating form. 

On the following pages, each major training module is briefly described, 
and the results of the evaluation of that module are noted. Tl^ese are 
follov;ed by a table showing the overall averages of the ratings for each 
irodule, and a sumrrarization of the comments made by participants atout the 
training program as a whole. On the basis of this data, the following con- 
clusions seem to be indicated. 
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The value of field trips , at least in the form and time used in this 

program, is questionable. A close examination should be misde for future 
such programs in terms of improving preparation of participants before naking 
the trips, closer liaison with the staffs of the facilities to be visited so 
that they can coordimte their presentations to the needs of the participants, 
more care in having facilities arranged and presentations planned so partici- 
pants can get full value from the trips, and close attention to the timing oi' 
the trips, both in terms of their place in the total context of the program 
and the time of day in which they are taken. 

In both ratings of individual modules and in commenting on the program 

as a v7hole, participants frequently noted problems with time. Ratings 
indicate that even for those nxxJules wliich were rated very highly, most 
participants felt that not enough time was given to individual points of 
information. In overall conir.ents, ther-e was frequent reference to the feel- 
ing that the 5 days d'jration of the program v;as too long and concentrated. 
The evaluation as such does not indicate what toLght be done alx)ut this 
problem, or if the conceiit"rated effort over time interfered v;ith learning. 
It appears that iTiany participants felt that if the ST^RC staff had not 
created such a relaxed and hospitable atTix:>sphere the time factor would have 
been more of a negative factor. 

superficial comparison of the ratings obtained during this program 

v;ith those recoi'ded by Str:inford/SDC during their validation of thieir program 
mterials indicates that tlie SI-EFlC program generally received significantly 
higher ratings. Hovjever, such comparisons are at best questionable given 
the differences in presentations., scheduling, participants and other factors. 
If there is any validity to them at all, they may indicate that a training 
program held in an operating facility, and led by tlie staff of such a 
facility, may be better r€K:eived by particip>ants. 

In any case, the results of the ratings and collection of co;iments 
indicates that the participants :Ln this training program considered it to 
be a most successful one, and it is SMERC's intention to use many of the 
mterials and approaches used in the program in future training efforts.' 

NOTE : The rating form used asked participants to rate each item for each 
module on a poor-fair- good continuum. Scores were computod using poor=0, 
fair=l, and good=2. Except for Module 12, N ranged from 17 to 21. 
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MODULE 1 . Present Structure and Future Plans for Information Systems ^ 
and "Post-Sputnik^' Trends in Education . A presentation by 
Dr. Fvank Mattas, including the film "Future Shock" and 
open discussion. 



CONTENT: MEAN SCORE 

Relevance of material to educational dissemination 1.68 
center operations 

Level of material relative to "entry level" of 
trainees 

Authori tat ivcness of material 1.60 

Instructional stratep^y (e.g., presentation, role 2.00 
playing, exercises, ecc.) 

Coverage of major points within topic 1.71 

Allocation of time to each point l.Al 

Illustrations or cMcmplcs 1.55 

CONDUCT: 

Arrangements or context for the session 1.83 

Choice of trainer(s) 1.94 

Effectiveness of presentation(s) 1.71 

Appropriate involvement of group in session 1.39 

Responsiveness of trainer(s) to questions . 1.50 



MEAN SCORE - ALL ITEMS 1.85 



ERLC: 



17 



MODULE 2. In-depth T ou r of SMERC as an operating Educational Resources 

Center. Module directed by Mrs. Marcia Garroan and Ms. Sevilla 
Finley of the SMERC staff. 



CONTENT: MEAN SCORE 

Relevance of material to educational dissemination 1.95 
center operations 

Level of u^aterial relative to **cntry level'' of 1.68 
trainees 

Authoritit ivcness of ir.atcrial 2.00 

Instructional striategy (e.g., presentation, role 1.59 
playing, exercisos, etc) 

Coverage of major points within topic 1.74 

Allocation of time to each point 1.22 

Illustrations or examples 1.71 

CON' DUCT: 

Arrangements or context for the session 1.68 

Choice of traincr(s) 1.94 

Effectiveness of presentation(s) 1.65 

Appropriate involvement of group in session 1.71 

Responsiveness of trainer(s) to questions 1.94 



MEAN SCORE - ALL ITEMS .1.73 
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MODULE 3, The Linkage System, the Client System, and the Resource System ^ 
2 presentation by David Rawnsley of SMERC. 



CONTENT: MEAN SCORE 

Relevance of iraterial to educational dissemination 1.89 
center operations 

Level of material relative to '*entry level" of 1.84 
trainees 

Authoritat iveness of naterial 2.00 

Instruct icnni strrLtcgy (e.g., presentation, role 1.78 
playing, €:xercisc3, etc.) 

Coverage of r^ajor points within topic 1.89 

Allocation of tine to each point 1.71 

Illustrations cr <i^:ar.ples 1.76 



CONDUCT: 

Arrangements or context for the session 
Choice of trainer(s) 
Effectiveness of presentation(s) 
Appropriate involvement of group in session 
Responsiveness of trainer(s) to questions 

MEAN SCORE - ALL ITEMS i-85 



1.67 
2.00 
1.94 
1.65 
2.00 
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MODULE 4, Introduction to Negotiations , including presentation and critiqu 
of three negotiation examples by Ms. Sevilla Finley, Ms. Nancy 
Flynn, and Ms. Leslie Quintero, and Mr. David Rawnsley, all 
of SMERC. 



CONTENT: ' MEAN SCORE 

Relevance of material to educational dissemination 1.95 
center operations 

Level of material relative to ''entry level" of 1.90 
trainees 

Authoritativoness of material 1.85 

Instructional strater.y (e.g. , presentation, role 1.95 
playing, exercises, etc.) 

Coverage of major points within topic 1.90 

Allocation of time to each point 1.75 

I-Ilust ratior.s or cxar.p].cs 1.74 

CONDUCT: 

Arrangements or context for the session 1.80 

Choice of trairier(s) 2.00 

Effectiveness of presentation(s) • 1.90 

Appropriate involvement of group in session 1.75 

Responsiveness of trainer(s) to questions 2.00 



MEAN SCORE - ALL ITEMS 1.87 
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MODULE 5. The Use of the Thesaurus and subject descriptors, an introduction 
and demonstration by Ms. Leslie Quintero. 



CONTENT: MEAN SCORE 

Relevance of material to educational dissemination 1.90 
center operations 

Level of material relative to "entry level" of 1.65 
trainees 

Authoritativeness of material 1.89 

Instructional strategy (e.g», presentation, role 1.74 
playing, oxcrcis'j:; , etc.) 

Coverage of major points viihin topic 1.80 

Allocation of time to each point 1.32 

llJLust rat ions or cxauiplcs 1.89 

CONDUCT: 

Arrangements or context for the session 1.78 

Choice of trainGr(s) 1.95 

Effectiveness of presentation(s) 1.74 

Appropriate involvement of group in session 1.75 

Responsiveness of trainer(s) to questions 1.82 



MEAN SCORE - ALL ITEMS 1-77 
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MODULE 6. Establishing and Organizing the Collection , a presentation by 
Mrs. Marcia Garman concerning the acquisition, organization, 
and maintenance of ERIC materials, journals, fugitive information, 
and special files, with a brief presentation by David Rawnsley 
on reference n^aterials. 



CONTENT: MEAN SCORE 

Relevance of material to educational dissemination 2.00 
center operations 

Level of material relative to "entry level" of 1.41 
trainees 

Authoritativeness of material 1.81 

Instructional strategy (e.g., presentation, role 1.56 
playing, exorcises, etc.) 

Coverage of major points within topic 1.50 

Allocation of time to each point 1.31 

Illustrations or cxa::',plcs 1.76 



CONDUCT : 

Arrangements or context for the session 
Choice of trainer(s) 
Effectiveness of presentation(s) 
Appropriate involvement of group in session 
Responsiveness of trainer(s) to questions 

MEAN SCORE - ALL ITEMS 1.64 



1.59 
1.94 
1.76 
1.50 
1.62 
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MODULE 7. Site Visit to Lockheed' DIALOG including presentations by Lockheed 
personnels (Coinnents were also elicited from a sub-sample of 
participants, these comments appearing on the next page.) 



CONTENT: MEAN SCORE 

Relevance of naterial to educational dissemination 1,25 
center operations 

Level of material relative to "entry level" of 0.85 
trainees 

Authoritativeness of material 1,50 

Instructional strategy (e.g., presentation, role 0.47 
playing, exercises, etc.) 

Coverage of major points within topic 0.85 

Allocation of time to each point 0.55 

Illustrations or examples 0.84 

CONDUCT: 

Arrangements or context for the session 0.94 

Choice of trainer(s) 1.00 

Effectiveness of prcsGntation(s) 0.50 

Appropriate involvement of group in session 0.55 

Responsiveness of trainer(s) to questions 1.17 



MEAN SCORE - ALL ITEMS 0.80 
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COMMENTS ON MODULE 7 (Site Visit to Lpckhced DIALOG) . 



The 7 participants asked to comment on this module stated the following 
(in summary). , 



FRir 



4 felt that holding the presentation in the computer room, 
which was noisy and crowded, made it impossible to get value 
from the visit. j^?---^ 

3 felt the information was needed as part of the training 
program, but was not well presented. 

3 felt the vitit was unnecessary. 

V 

2 felt the presentation was too technical. 



24 



MODULE 8, Introduction to Computer Use ^ a demonstration at the terminal 
at SMERC by Mrs, Katherine Clay of SMERC. 



CONTENT: ' MEAN SCORE 

'Relevance of material to educational dissemination 1%95 
center operations 

Level of material relative to "entry level" of 1%80 
trainees 

Authoritativeness of material 1.90 

Instructional strategy (e.g., presentation, role 2,00 
playing, exercises, etc.) 

Coverage of major points within topic 1.85 

Allocation of time to each point 1.70 

Illustrations or examples 1.89 

CONDUCT : 

Arrangements or context for the session * 1.84 

Choice of trainer (s) 2.00 . 

Effectiveness of presentation(s) 1.85 

Appropriate involvement of group in session 1.70 

Responsiveness of trainer(s) to questions 1.88 



MEAN SCORE - ALL ITEMS 1^86 



ERLC 



25 



MODULE 9. Retrieving ERIC and FIDO Infomatlon , an activity in which 

participants were divided into teams and performed negotiations, 
"hands-on" searching, and reporting back to clients. 
Assistance and critiquing were given by SMERC staff. This 
module used ap^proximately 6 hours of training program time. 



CONTENT: MEAN SCORE 

Relevance of material to educational dissemination 1.85 
center operations 

Level of material relative to "entry level" of 1.80 
trainees 

Authoritativeness of material 1.83 

Instructional scrategy (e.g., presentation, role 1.85 
playing, exercises, etc.) 

Coverage of major points within topic 1.65 

Allocation of time to each point 1.15 

Illustrations or examples 1.81 

CONDUCT : 

Arrangements or context for the session 1.84 

Choice of trainer(s) 1.95 

Effectiveness of prcsentation(s) 1.83 

Appropriate involvement of group in session 1.88 

Responsiveness of trainer(s) to questions 1.88 



MEAN SCORE - ALL ITEMS 1.77 
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MODULE 10. "Entry Strategies " to* clientele for field agents and project 
managers, a discussion lad by David Rawnsley, attended only 
by those who would be fulfilling these roles. (n=6) 



CONTENT: * ^ MEAN SCORE 

Relevance of material to educational dissemination 1.84 
center operations 

Level of material relative to "entry level" of 1.67 
trainees 

Authoritativeness of material 1.83 

Instructional strategy (e.g., presentation, role 1.83 
playing, exercises, etc.) 

Coverage of major points within topic 1.67 

Allocation of time to each point 1.50 

Illustrations or examples 1.83 

CONDUCT: 

Arrangements or context for the session 1.40 

Choice of trainer(s) 2.00 

Effectiveness of presentation(s) 1.67 

Appropriate involvement of group in session 1.67 

Responsiveness of crainer(s) to questions 2.00 



MEAN SCORE - ALL ITEMS 1.74 
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MODULE 11. Selecting Equipment , a discussion by Dr. Frank Mattas concerning 
buying, leasing, maintaining and using equipment necessary to 
information center or linking agent operations. 



CONTENT: MEM SCORE 

Relevance of material to educational dissemination 1.88 
center operations 

Level of material relative to "entry level" of 1.66 
trainees 

Authoritativeness of material 1.71 

Instructional strategy (e.g., presentation, role 1.33 
playing,, exercise?^, etc.) 

Coverage of major points within topic 1.68 

Allocation of tima to each point 1.36 

Illustraticr.s or examples 1.74 

CONDUCT: 

Arrangements or context for the session 1.70 

Choice of trainer(s) 1.94 

Effectiveness of presentation(s) 1.61 

Appropriate involvement of group in session 1.53 

Responsiveness of trainer(s) to questions 1.77 



MEAN SCORE - ALL ITEMS 1-66 
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MODULE 12. Site Visit to an Operating ERIC Clearinghouse , A tour of 
the ERIC Clearinghouse for media and technology, Stanford 
University. 



Since the rating form was not gennane to this activity, participants werei 
only asked to write comments about the Module. These comments are summarized 
as follows. Of the 19 participants who made comments: 

9 stated the trip was interesting, worthwhile and relevant to 
the training program. 

7 stated that the trip was interesting or fun, but either not 
relevant to the training program, or of little value to them 
in their role. 

4 said that the trip should have been taken at a different time 
(it was taken late in the afternoon of the fourth day of 
training), since they felt too tired and/or sated with infor-r 
mation to get much out of it. 

3 were impressed X7ith the building in which the Clearinghouse 
is housed. 

3 made comments complimentary to the Director of the Clearinghouse, 
who led a question-and-answer period. 
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tiODULE 13. Docu m enting and Evaluating Service Activities , a discussion 
by Mrs. Marcla Garman and other SHERC staff on assessing 
searches, using the search form for documentation purposes, 
and related concerns. 



CONTENT: MEAN SCORE 

Relevance of m.iterial to educational dissemination 2.00 
center operations 

Level of material relative to ''entry level** of 1.84 
trainees 

Authoritativencss of material 1.77 

Instructional strategy (e.g., presentation, role 1.59 
playing, exercises, etc.) 

Coverage of major points v;ithin topic 1.80 

Allocation of time to each point 1.63 

IljLustraticns or examples 1.84 



CONDUCT : 

Arrangements or context for the session 1,74 

Choice of Lrainer(s) 1.63 

Effectiveness of presentation(s) 1.72 

Appropriate involvement of group in session 1.55 

Responsiveness of tralncr(s) to questions 1,76 



MEAN SCORE - ALL ITEMS 1.74 
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Overall Ratings of Training Program . The following averages reflect 
participant ratings of all modules as*raported on the preceding 
pages, except for nodule 7 (site visit to Lockheed DIALOG), which 
was excluded as the only module rated which was not led by SMERC 
personnel-* Participants were also asked to write general comments 
concerning the 5-day program as a whole. These comments are 
summarized on t h^ following page, 

CONTENT: MEAN SCORE 

Relevance of material to educational dissemination 1,90, 
center operations 

Level of material relative to "entry level" of 1,71 
trainees 

Authoritativeness of material 1.84 

Instructional strategy (e.g., presentation, role 1.75 
playing, exercises, etc.) 

Coverage of major points within topic . 1.77 

Allocation of time to each point 1,46 

Illustrations or examples 1.78 



CONDUCT: 

Arrangements or context for the session 1.74 

Choice of trainer(s) 1.93 

Effectiveness of presentation(s) 1.77 

Appropriate involvement of group in session 1.65 

Responsiveness of trainer(s) to questions 1.83 



MEAN SCORE - ALL ITEMS 1.76 
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OVERALL COMMENTS 



At the end of the training program, all participants (20) were asked to write 
their overall impressions of the Program, and any specific ideas they might 
have for improving. (Since comments had already been elicited concerning the 
two field trips, participants did not include them in this commentary.) The 
following is a summary of these overall impressions. 

17 stated that the Program was "excellent", "very worthwhile", 
"very good", "great", or some sim:llar complimentary term. 

9 made comments complimentary to the friendliness, hospitality, 
cooperativeness, etc . of the SMERC staff. 

6 felt that the organized social activities for participants 
and staff were excellent and worthwhile in setting a 
relaxed tone for the total Program. 

5 felt that 5 days extensive training was too long. 

3 felt they would have benefitted by spending more time 
actually doing search related activities. 

3 were impressed by the various materials and examples given 
to the participants. 

2 stated that they would have liked to have had a glossary of 
terms before and during the training. 



ERLC 



32 



2S-20 



MODULE 5. Field Visit to Operating 
Educational Resources Center 

Please circle one: 



co:;if.:;t: 

Relevance of r.n 'serial to educational disser.ination 



center operations 




POOR 


OK 


GOOD 


Level of material relati':e to "entry level" 
trainees 


of 






GUUD 


Authoricat ivenesrs of raterial 






Or. 




Ins true t icnal stra^(-^y (e.§., presentatlo:i, 
playin;,:;, c:'.irci:.-::S , ctz.) 


rc le 


POOR 


OK 


GOOD 


Cover a. -re cf rzazov pcints vithin topic 




VOOR 


OK 


GOOD 


Allocation of ci;.;e to each point 




POOH 


CK 


CCCD 


Illustrations or e:carr.ples 




POOR 


OK 


GOOD 


r.verr i c;;:i.- n>- cbeckli^it:? (if ^:^ed) 






nrr 




corn^uci: 










Arran'jerr.ents or conttirrt for the session 




POOR 


OK 


GOOD 


Choice of trainer(s) 




POOR 


OK 


GOOD 


Effectiveness of presentationCs) 




POOR 


OK 


GOOD 


Appropriate invoiver.:2nt of group in session 




POOR 


OK 


GOOD 


Administration of exercises, checklists (if 


used) 


POOR 


OK 


GCOD 


Responsiveness of trainer(s) to questions 




POOR 


OK 


GOOD 



CO:"!E:rr: Does th.3 r.odule have any particular strengths or veaknp.sses 
that you vculd like to nention? (Please use space below.) 
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APPENDIX A 



TITLES OF PUBLICATIONS 



I^IAJOR SMERC PUBLICATIONS 
from July 1, 1972-July 31, 1973 



Bibliographies, Resource Guides, and other Publications 



Innovation and Change (Arizona) 


June 1973 


Problem Solving/ In Service (ACSA) 


June 1973 


Assessment Strategies 


May 1973 


Negotiations 


April 1973 


Career Education 


March 1973 


Early Childhood Education 


February 1973 


Decentralization of Decisionmaking 


January 1973 


Performance Contracts/Educational Vouchers 


December 1972 


Emotionally Disturbed Children 


November 1972 


Year Round Schools, revised 


October 1972 


Teacher Pvesources Material/Learning Centers 


September 1972 


Administrator Evaluation 


August 1972 


Year Round Schools 


August 1972 


Quininester Program 


March 1973 


Brochures for Arizona 


December 1972 


Fall 1972 FIDO Catalog 


November 1972 


LaVerne College Catalog 


October 1972 


School-Conimunity Communication (ACSA) 


September .1972 


Brochures 


July 1972 



News Notes 

June 1973 
April 1973 
January 1973 
December 1972 
October 1972 
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APPENDIX B 



MEMO TO STATE DEPARTMENT 



ERIC 



PROPOSED SERVICES FOR THE CALIFORNIA STATE DEPARTMENT OF EDUCATION 



by the San Mateo Educational Resources Center 
San Mateo Superintendent of Schools Office 
Redwood City, California 
Dr, Frank Mattas, Director 
May. 1973 

A. SEARCH SERVICES FOR STATE DEPARTMENT PERSONNEL 

SMERC proposes to provide the following services to State Department 
personnel : 

1. Provide ERIC, FIDO, CUE and other data file searches under the 
same conditions as for other clientele* for use in situations such 
as the following: 

When assisting a district or other agency in program development 
and similar activities 

In providing background information to proposal evaluation teams 

In providing background information to Matrix teams 

In providing background information committees, councils, and 
similar groups 

When developing proposals, State plans, and similar itjms for 
submission to other agencies, such as the Federal government 

2. Provide training for appropriate State Department personnel in 
information system use and informauion management. An altsrnati/e 
to a massive training program might be to train approximately 15 
S:ate Department employees as linking agents, and have all State 
Department searches be negotiated by these agents. 

3. Vtien requested, develop and print Resource Guides, Bibliographies 
and similar publications in sufficient quantity to serve the 
publications purpose for use by task forces, committees, or other 
State Department groups. 

4. Provide up to 400 copies of other SMERC publications ^approximately 
9 per year) for use by State Department personnel. 



* Clients of SMffiC may make an unlimited number of search requests. For 
each search, up to 10 microfiche and 20 pages of photocopy are provided 
free of charge. Additional microfiche cost 15C per '^fiche", and lOc per 
photocopied page. Wlien appropriate and requested, a computer printout of 
abstracts of documents relevant to the search from ERIC and CUE will also 
be included. All materials sent by SMERC in response to a search request 
become the property of the requestor, ard need not be returned to SMERC. 
Cost for these services would be $25,000 per year. 
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DATA STORAGE AND RETRIEVAL 



SMERC has a unique document storagfe, retrieval and delivery system, the 
use of which is presently concentrated on documents describing research, 
programs and similar educational information. The use of this storage and 
retrieval capability could be expanded to include any data or material which 

Has a life span sufficient to make inclusion in a data bank 
worthwhile (e.g. one year). 

Would be sufficiently in demand to make inclusion in a data file 
cost/ ef f ective . 

Can he effectively used by clients in microfilm, or is of a nature 
that parts can be used fully reproduced in hardcopy by the client 
or SMERC. 



Such data could include statistical information, reports, guidelines, 
standard, formats and any other information which meets the criteria 
above. In order to implement such a service the following would be 
required: 

Determination by the State Department that it had a sufficient 
quantity of data to call for such a service (this would include 
data which is presently in demand and data which may not be used 
at present because of inaccessibility). 

Establishment within SMERC of a separate California file for 
this data (this is a relatively minor step). This file should be 
developed in such a way that either a total document or parts of 
it can be retrieved. 



Production of a catalogue for the file. 



Establishment of a system for assuring periodic purging and 
updating of data. 



CLIENTELE 



The best means of supporting such a service would appear to be a single 
contract with the State Department which would give access to the file 
for any citizen of California, or any employee of a school district or 
public university in the state. In this case the service would be above 
and beyond the services presently provided clients by SMERC through 
contract with counties and other agencies. Access to the service could 
be either directly to SMERC or through SMERC 's linking agents or satellites. 
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APPENDIX C 



PROPOSAL ON COMPUTERIZING FIDO 



ERIC 



San Mateo County Office of Education 
EDUCATIONAL RESOURCES CEOTER 
333 Main Street, Redwood City, CA 94063 



A Request for an award from the National Institute for Education (ERIC) 
to develop a procedure and process a group of locally acquired materials 
for inclusion in an "on-line" computer program. 

San Mateo County Educational Resources Center (SMERC) is currently 
operating an educational information and dissemination center, providing 
ERIC, periodical, book and locally (collected fugitive materials for 
educators in an information networ^iC throughout California and Arizona. 
The service includes expanding the acquisitions program of the Center 
and providing for rapid and effective "on-line" retrieval of ERIC and 
CUE materials through the Lockheed DIALOG System. It is proposed that 
this service be augmented by providing "on-line" retrieval of locally 
collected materials for all DIALOG "on-line" users and making a magnetic 
tape reel of those materials available to any other on-line retrieval 
system interested. 
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TECHNICAL DISCUSSION 

» 

San Mateo County Educational Resources Center wishes to submit a 
proposal for consideration of an award for unsolicited funds for the 
development of a procedure* and the processing of a group of locally 
and/or regionally developed resource materiaU- for inclusion In the 
Lockheed DIALOG on-line retrieval system. The resulting file would be 
available for access by all Lockheed DIALOG on-^ine users, 

In this proposal we identify those types and kinds of resource 
materials to be considered and the maximum number to be processed and 
accessioned and the ultimate benefits to be derived for professional 
education and decision-makers throughout the DIALOG on-line system. 

PROBLet AND OBJECTIVES 

1. During the past four years major studies have been made in 
creating an ERIC and Current Index to Journals in Education (CUE) on-line 
retrieval system. The U.S. Office of Education through N.CE.C and now 
the new National Institute for Education has played a major role in 
developing the on-line system, particularly through the Lockheed DIALOG 
System* This very success of the on-line system has sharpened the aware- 
ress in the state and local educational information agencies of the value 
of on-line retrieval of all types of fugitive information. More and more 
it has become apparent that in order to develop more broadly based retrieval 
systems, fugitive materials and resources not a part of the accessions of 
ERIC and CUE must be included within a center^s on-line search capabilities. 
Also, aggressive acquisition of new fugitive materials must be a continual 
part of a center's activities. 

In order to meet these needs, SMERC has had to develop loca"*. resource 
banks independent of those documents cited in R.I.E, and CI.J.E, Because 
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of this acquisitions policy, many materials have been acquired and cited 
in the Center's Fugitive Information Data Organizer (FIDO) Catalogues. 
This highly useful collection of fugitive materials has become cumb?r6ome 
to search in a "by hand" manner. 

The problem is that at the present time some ten thousand documents 
pertinent to current awareness searches are being hand searched through 
the FIDO Catalogues. Also, there is very little in the way of coordinated 
effort either within states or among the states to share locally accessioned 
materials. Because existing and planned educational information operations 
are largely independent efforts, the great potential for cooperative — and, 
thus, more cost-effective — operations is not being realized. To achieve 
a stable economic base for the sharing of fugitive information, it is 
essential that on-line agencies be given the opportunity to review collec- 
tions from other state and federal agencies without having to acquire the 
collections on their own. Thus far, the necessary broad base for these 
on-line services has not been developed. SMERC is in an excellent position 
to develop the capacity and provide some of the rapid delivery system. 

SMERC feels that the most desirable model for this activity is to 
prepare and place on-line in the Lockheed DIALOG Computer a minimum of 
2500 fugitive documents (with the possibility of escalation to 7500) that 
would have interest to other state and local agencies using the DIALOG 
System. The implementation of this model will require the ^^lection of 
the most pertinent documents, accessioning by ERIC descriptors, key punching 
to the requirements of Lockheed DIALOG and the procedures necessary by 
Lockheed to actually place "on-line". 

2. Objectives - SMERC, in close cooperation with other information 
agency personnel, will work to promote the development of an "on-line" 
collection of fugitive materials. The specific objectives to be achieved 
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by the SMERC Center in providing this "on-line" collection are as follows: 
Objective 1 . Given the present SMERC FIDO Catalogues, and other 
fugitive materials, SMERC staff members will identify at least 
2500 such materials as worthy of accession In the DIALOG computer 
for use by other state and local agencies. 

Objective 1 . Given 2500 or more fugitive documents SMERC staff 
members vill accession and process said documents in a manner that 
is compatible with ERIC procedures, i.e. ERIC Thesaurus Descriptors^ 
and format etc. and include a one to three line summary of 20 or 
more words describing the contents of each document. All documents 
cited will be placed in microfiche format for dissemination upon 
request. "Fiche" will be reproduced at SMERC at a cost of 25c per 
f iche. 

Objective 3 * Given 2500 or more properly accessioned' fugitive 
documents by ERIC format, San Mateo County Office of Education 
Electronic Data Processing personnel will "key punch" to Lockheed 
DIALOG specifications for accessioning into the DIALOG System. 

Objective 4 . Given 2500 or more EDP "key punched" documents 
SMERC personnel will deliver all such materials to Lockheed DIALOG 
at Sunnyvale, California for inclusion in the on-line system as a 
new and separate on-line file available to all DIALOG "on-line" 
users. 



DESCRIPTION OF ACTIVITIES 

SMERC will provide the staff and initial fugitive documents to carry 

out the objectives outlined in the preceding section. The proposal will 
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cover a period of approximately 30 to 45 days, under the direction of 
Frank Mattas. Frank Mattas is responsible for the initial development 
and the continuing operation of the San Mateo County Educational Resources 
Center. In addition to pibviding technical direction of the proposal, he 
will be responsible for the delivery of the processed documents to Lockheed 
DIALOG (Dr. Roger Summit) of either key punched index cards or a mini reel 
of magnetic tape. A short report describing the project results will be 
forwarded. 

COST ESTIMATES 

Project Director: F rank W. Mattas Institution; San Mateo County 

Board of Education 

Proposed Duration: 30-45 days Starting dat e; Open 

A* Direct Costs 

It is estimated that a cost of $2.80 per document will be 
required • Thus, for 2500 documents the total cost would 
be $7,000. This breaks down along the lines of the objec- 
tives as follows: 

Objective 1 . Scan 10,000 documents by research assistant 
staff members for those 2500 plus documents best meeting 
the requirements for inclusion in the data base. It is 
estimated that 200 man hours @ $5.00 per hour would be re- 
quired. Total coPt • 000*00. 

Objective 2 > SMERC staff will process 2500 plus documents 
to R»I.E. format. This would include accession number; 
author; title; institution; publishing date; pages; 5 
descriptors; and a summary of 20 to 25 words. It is esti- 
mated that 800 hours would be required @ $5.00 per hour. 
Total cost « $4,000. 
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Oblective 3 . Vue San Mateo County EDP Center would key 
punch 2500 documents for $1,000.00. Total cost = $1,000.00. 
Objective 4 , SMERC costs by Lockheed DIALOG to place 2500 
documents "on-line" would be $1,000.00. Total cost = $1,000.00. 
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APPENDIX E 



ARIZONA EVALUATION 



ASSESSMENT OF SERVICES PURSUANT TO THE CONTRACT 
FOR SERVICES BETICEEN SMERC AND AEIS 
DURING THE SCHOOL YEAR 1972-73 

The period covered by this report was from October 1, 1972 
to May 1, 1973. (The months of May and June 1973 are covered by 
the contract y but not covered by this report). During this period 
a total of 624 searches were performed under the contract, of 
which 158 vere reproduction searches (i.e. searches in which 
the requestor ordered specific documents), 147 were computer print-- 
outs, and 319 were in-depth searches. Duiimg most of the period, 
AEIS. was serving clientele including approximately 93,000 ADA, 
plus the faculty of the ASU College of Education. During the 
Spring, I understand AEIS began serving a number of relatively 
small districts, although I don't know the exact number of ADA 
involved. 

EVALUATION ; 

In April 1973, an evaluation of services to AEIS clientele by SMERC was undertaken, 
using the following methodology: 

1. A random sample of computer and in-depth searces done during 
January, February, and March was selected by taking every 
5th search from the files until 50 searches were included. 

2. A brief questionnaire and request for comments was sent directly 
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to the person requesting the search under my name (a copy of 
this questionnaire is attached). The date and subject of the 
request was included on the form, since a number of clients 
had made multiple requests, and we were primarily interested 
in their reactions to a specific search. 

3. A return envelope was included with each questionnaire. 

4. A copy of the questionnaire was sent to Dr. King of AEIS for 
his review. 

Results Were As Follows; 

A. Of the 50 questionnaires mailed, 32 (64%) were returned prior 
to June 1, 1973.5^ Two of these returns were not Included in 
s;,he data below, one being from the head of a committee whose 

group had not yet used the information and therefore had no reactions 
to it, and the other being a search inadvertantly included in the 
evaluation in which the requestor knowingly asked for information 
which he suspected SMERC did not have, and received a note that 
that was in fact the case. 

B. The major purposes of the evaluation were to gain an overall 
impression of client reaction to the service, and to uncover 
specific problems or indications which might lead us to ways 
of improving the service. 

C. The following results were gained for each question on the 
questionnaire. The comments following are in part based on 
results expected according to a set of simple hypotheses 
developed by the author at the time of development of the 
ques t ionnair e . 

1. Relevance 



Choice* * Responses 

£i. all relevant 9 

b. relevant with the exception of 

one or two items 12 

c. included only one or two relevant 

items 7 

d. was not relevant 2 



* Since SMERC serves AEIS clientele indirectly (i.e. through AEIS and district 
coordinators) we did not have addresses for specific clientele except in terms 
of schools and districts. A number of educated guessec and vague addresses 
were used by necessity in mailing questionnaires, and at least 6 questionnaires 
were returned by the Postal Service because of inadequate address. Second 
attempts were made in these cases, but no attempt was made to find out if these 
were successful, and there is no reason to believe that any bias resulted from 
this difficulty. 

** Choices for all questions are paraphrased for convenience in this report. See 
the questionnaire appended for full statements of the choices. 
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It was expected, given the nature of the negotiation and search process « that most 
replies would be In the second (b) form. More than expected In fact replied that all 
Information was relevant. However, a few more than were expected replied In the last 
two categories, which basically are negative responses. Lack of relevance can either 
be a problem of Inadequacy of the collection or a problem In negotiation. An examine*- 
tlon of the searches Involved Indicate that the latter is the case. An example is one 
of the questionnaires which was marked "not relevant." The search negotiated centered 
around the concept of curriculum analysis in special education. The note appended to 
the questionnaire indicated that the requestor was interested in ways ot evaluating 
special education programs (about which there is considerable Information in the 
collection). Further discussion about negotiation is included later in this report. 

The other questionnaire which was marked "not levant" is of interest, too, from 
the standpoint of communications within the total system. The request was for infor- 
mation about the geography of Baja California. The request realistically does not 
fall within the range of information with which SMERC deals, and it was the under- 
standing of the negotiators that everyone assumed any search "hits" would be pure luck. 
The response to the request included some related information, and some references to 
other sources of information. Therefore, the reply of "not relevant" would be expected. 
However » as a point of interest, personnel at least twice were complimented by the 
coordinator of the district from which the request emanated for coming up with anything, 

2. Uniqueness of Information 



Choice Responses 

a. almost all new 7 

b. divided between new and information 
already available 20 

c. not new Information 3 



Since the Information System has no way of knowing what information is already 
available to the requestor, and since one can assume that many requeutors know some- 
thing (that Is, have some information) about the area in which they make a search 
request, it is no surpr:'se that 2/3rds of the responses fell into the second category* 
Overall, responses to this question are highly positive. Further analysis of the 
searches responding "not new" indicate that one was in an area of cybernetics (machine 
analysis of subjective content) which is realistically outside of the realm of an 
education-oriented system, and the other two (one of which was described in the 
comments on question 1) appear to be problems of negotiation. 

3* Use 



Choice Responses 

a. myself, for personal and pro- 
fessional growth 10 

b. myself, for use in planning, etc. 17 

c. a committee or team 8 

d. other 2 



This question was included to ascertain whether there were any categories of unusual 
use or tendencies which might effect the search and delivery process. Although analysis 

*A number of respondents gave multiple answers. 
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of responses by source of request (Elementary Schools > High Schools > University 
faculty) revealed no tendencies In terms of the other questions on the questionnaire 
(with the exception of Question 5) almost 1/2 of the high school level respondents 
Indicated that the information was being used by a committee or team» while only 1/5 
of the Elementary School level responses and 1/9 of the University faculty responses 
were so marked. This Is perhaps due to the departmental structure of most high schools^ 
but it is unclear at this time what special consideration in search and delivery is 
called for. Perhaps if future evaluations or experience reinforce this findings it 
would be worthwhile to consider some special approach to departmental search requests. 

4. Usefulness 

Choice Responses 

a, very useful 16 

b, useful, except- 7 

c, not very useful because — — 7 

Every Information service would like to think that all the information It dispenses 
is very useful, but this is asking for more than Is possible. However, since almost 
half of the respondents felt the information they received was at least compromised 
in its usefulness, it was felt to be necessary to analyze these 14 responses. Of 

tliose marked "useful, except (1) 3 made no indication of what the exception 

was (but one indicated in a comment that he had not defined his question well and 
was pleased enough to use the service again) ; (2) 2 indicated that they liked what 
they got, but could have used more information; (3) 1 indicated that too much material 
was received, and had too much to get the 'Wat"; (4) 1 indicated that the information 
arrived too late to be useful (see Question 5) but was generally positive about the 
information received. 

Numbers 2 and 3 do not seem to me to be serious difficulties within the context of 
the total system, given the^ relatively small number of clients so responding. 
Number 4 is discussed under Question 5 below. If we assume that those included In 
Number 1 represent basically negative responses (and they in fact may not) we are 
still left with a relatively small group, and I would conclude that this total set 
of responses does not represent an indication of a serious problem, particularly 
with the collection's usefulness or the degree to which search pi^ocesses or personnel 
find useful information* 

Of those marked "not very useful because " (1) 3 appeared, from the* comments 

made, to be misunderstandings in negociation (one of which took responsibility 
himself for the confusion and was very complimentary to the sexrvice); (2) 2 appear 
to be searches outside of the field covered by the SMERC collection (the Baja 
California and Cybernetics searches described in comments on Question 1); and (3) 
2 were requests for information within the field of education for which the Research 
Assistant could not find the specific information requested (behavioral objectives 
for a Food course and plans for Math Centers/Jr. High) and sent related materials 
along with an explanation about the unavailability of the information. 

The questions of problems in negotiations will be discussed later in this report. 
Number 1 and Number 2 are indicative of a minor problem we had early in the year 
(both of these searches were made early in the period covered by the sample) in which 
a number of clients did not understand the limitations of the SMERC collection. This 
problem seems to have been consideiably ameliorated, particularly since the meeting 
of district coordinators early this spring which I attended* However, if there appears 
to be enough demand from all of SMERC *8 contracting agencies, we mi?ht want to consider 
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attempting to develop some sort of working arrangement with the many other special- 
ized information systems which exist nationally, so that we could refer clients to 
them. As an aside, the search in the area of Cybernetics was run through the NTIS 
file, with no hits, and inquiries were made at the Stanford University Artificial 
Intelligence Laboratory where, to be honest about it, our contacts were rather dis- 
dainful of the question (although most willing to try to help), 

K'iiinber 3 presents a more difficult problem, but one for which there seems' no 
immediate solution. If we find many instances of this type of inability to respond 
to a request, it might be worthwhile to establish an internal system for putting 
such searches in a "hold" category, explaining this to the client, and responding 
when information does become available (for example^ It is likely that by now our 
objectives file does contain some relevant items), Thare are two objections to this 
solution: 

- by the time information becomes available, it may be too late to be 
of use to the client 

- there may not be enough instances in which the situation occurs to make 
a systematic solution "cost-effective" 

It appears to me that this closer analysis of the instances in which responses 
which might appear to be negative to the question of usefulness ameliorates to i 
certain degree tha impression given by the data on responses alone. Those breal.downs 
which do exist- appear more often than not t.o be traceable to communications, both in 
terms of client understanding of the capabilities of SMERC and AEIS. and in terms of 
negotiation of searches. The latter point is covered elsewhere. The former I feel 
is being overcome as the clientele become more familiar with the system, and the 
heavy search load and generally favorable coiraaents on the service would indicate 
that whatever misunderstandings might exist are not having an adverse effect. 



Tiining 




Choice 


Responses 


a. about when expected 


16 


b. too late to be useful 


3 


c. later than expected, but in time 




to be useful 


11 


d. earlier than expected* 


2 



In view of the concern expressed by Dr. King a number of times during the year 
concerning the lateness of searches, the results of this question are pleasantly 
positive (particularly choice d). The relatively large number of responses in 
choice c was predictable; a similar finding was made in Sieber^s study of the 
USOE-NIE Linking Agent, pilot project » tThether or not choice c is a negative comment 
depends upon the frame of reference used. From the standpoint of information use 
it is at worst neutral, but may represent some problem in terms of public relations. 
Whether or not this is the case cannot be determined from the available data. 

If we assume on the basis of AEIS information, that there is some problem of 
undetermined degree in regard to late searches, this problem may lie in one of the 
following two causes: 



* Not included on the original questionnaire. 
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A. Investigation by K*;. Goodyear during April in.iicated that searches 
mailed to Arizona went from SHERC to the County Office mailroom, 
then to the County Manager's Office mailing facility, then to the 
Redxcood City Post Office, and finally to the San Ft?Ancisco Post 
Office before they headed south. I would not be surprised if 
something similar happens when searches arrive in Phoenix or Tempe. 
As you may remember, we had decided to short cut this system by 
doing our own stamping and mailing, but I did not implement this 
because the problem of complaints about lateness seened to ameliorate 
as the Spring went on. An investigation of mailing practices and 
time-lines by AEIS in its area would be most useful. 

B. Analysis of the data received in the evaluation by school level 
showed that 58% of the searches sent to elementary sch ^Is resulted 
in a response of lateness. This rate is over 20% higher than 
those for colln:>e or high school faculty. Since we make no dis- 
tinction between juch levels in scheduling searches, this figure 
would indici^to some difficulty in the delivery system after searches 
leave SMERC. I would guess that this hang-up occurs after searches 
are delivert:d to District Coordinators by AEIS and is based on the 
fact of there being more schools to deliver things to in most 
elementary districts compared to the other levels. In any case, 
AEIS may be interested in trying to pinpoint the difficulty, and 
taking whatever action is appropriate. 

6. Research Assistant Notes 



Choice Responses 

a. no note 5 

b. didn' t notice 3 

c . informative 18 

d. not informative 4 



Although these results seem generally positive, two observations need to be made: 
(1) Choices a and b can be taken as the same; i.e., any number of those in Choice a 
may have in fact received a note but didn't see it and therefore concluded that there 
was none. It is probably worthwhile to consider redesigning the form which is in- 
cluded with search results in order to give the RA's note more prominence, since in 
many cases it is too important a communicaLinn about the search to risk the possi- 
bility that almost 1/3 of those receiving sea^tches do not see it. (2) At least two 
of the searches in Choice d are ones which we have previously analyzed as being 
outside the range of the SMERC collection. In these cases the choice (in full) "I 
read the note^ but it didn't tell me much about, the search" is ambiguous at best. 

7. Bibliographies and Resource Guides 



Choice ^ Responses 

a. have not seen 7 

b. seen but not used 13 

c. have used 10 



This question was asked in order to assure that the majority of clientele had at 
least seen some of our publications, and to ascertain whether or not there was any 
pattern to availability or unavailability. The results would indicate that the 
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availability of such documents is satisfactory, although one can^t help but wonder 
about the fact that some 23% of the respondents who knew abovt the service (at least 
so far as to submit a search request through it) had never seen oxis of these numerous 
publications. However, analysis of the results by institution level indicate that 
there is no tendency for ignorance concerning these publications to center in one 
type of Institution or another. 

COmSNTS 

All respondents were asked to make comments about the search in question, any other 
searches they may have requested, or about the service in general. As a result: 

10 made no comment (8 out of these 10 were respondents who gave positive 
responses to the questions concerning relevance and usefulness) 

14 made comments laudatory of the service - some examples; 
"This ic an outstanding service which tsaved me hours of time — " 
"Very pleased with it" 

"The material has been very helpful in our curriculum planning" 

"Most successful and useful" 

'*May I take this opportunity to encourage others to utilize the services 
that you offer. I aa sure they will find them as priceless as I did" 

" of the utmost importance to any school district. Thanks for your 

help" 

"I learned from this search request how to ask pertinent questions 

I plan to use the service again" 

6 made explanatory comments about their previous responses, or asked 
questions about the service. Some examples: 

"Search could have really been helpful if ths objectives had been 

stated in complete form" 
"I would like to see the materials contained by the Center expanded to 

include the scientific disciplines ---" 
"How do you index your materials? Could ycu send an index to districts 

or individuals?" 

\lo one made comments indicating that the service was of little or no use* Four 
of the 6 comment I?, noted immediately above, and 2 or 3 of the 14 positive comments 
indicated that there was some breakdown in negotiation of searches. I will conclude 
this report with some considerations on this topic. 

NEGOTIATION. 

Some facts about how the SMERC-AEIS system operated during the period covered by 

this report should be taken into account i^rhen considering possible problems concerning 

negotiations, 

1. The typical search request ^irom a school staff member was communicated 
from the requestor to the (^.is'irict coordinator, thence to AEIS, and 
from there to SMERC. Thus there are two "negotiations" between the 
requestor and the SMERC Research Assistant. 

2. In most cases the RA does not have contact with the reques.tor 
either before or after the search Is completed except through 
the note which Is usually appended to the search. Direct renego- 
tiation, if there appears to be a problem, has been too cumbersome. 



coni:^idering l:he distance and the number of the people involved, 
to be used. 

3. All negotiation between AEIS and SMERC if done by telephone. 

4. AblS staff received a 2 day training workshop at Redx^ood City, 
but this could not be considered extensive training. (It should 
be noted that, given this minimal training, and the fact that 

two staff members responsible for negotiation at AEIS are relatively 
inexperienced in the field of education, they have to all appear- 
ances done an excellent job and deserve much credit for having done 
so, and for the success of the service*) Some District Coordinators 
received about 6 hours of introductory training from the AEIS staff 
and myself, and may have received more as a result of AEIS acti- 
vities of which I am unaware, but certainly cannot be considered 
trained negotiators. 

Of tl ese considerations, it is my judgement that items 1 and 3 are of most concern. 
In reference to item 3^ AEIS has been coi:5idering acquiring a MTST capability for 
sQine time. If this step is taken, many of the problens of rushing through long 
telephone conversations, poor connections, and all the other disturbances to which 
long distance telephoning is susceptible will be ameliorated, if not solved. There 
are many indications that getting the MTST would also represent a cost savings for 
AEIS. If for some reai^on this step cannot be taken, I would suggest that appro- 
priate people from SMERC and AEIS get together to see if ways and means can be 
devised to relieve the present dependency on the telephone. 

Item 1 presents a more difficult problem. There are undoubt;edly good reasons for 
AEIS to have established and used the system as it is presently fonned, and it 
would be inappropriate for me to comment on it. On the assumption that these good 
reasons still exist, and the system of coordinators etc. will continue, the key to 
improving the process of negotiation would seem to be increasing the skill of the 
district coordinators as negotiators. Short of bringing all the coordinators to 
Redwood City for training, which neither AEIS, SMERC nor the individual districts 
can afford, I think between AEIS staff and ours we could devise some means for 
helping the coordinators in this function within the time and cost constraints of 
the contract. Whatever means might be arrived at, I think this is an area in which 
we should undertake cooperative planning of a specific program, r; t:her than relying 
on one or the other of us to be active on an '*ad hoc'* basis. 

It is my strong impression that, although we thought item 2 would be a problem, 
v'MERC staff and AEIS personnel have been able to handle renegotiation problems 
adequately, now that they have gotten to know each other better. I am willing to 
be <:orrected on this point, and on ray impression that item 4 is also becoming less 
anc. less a preblera as the AEIS people gain experience. However, we should be alert 
to any oppm: runlty that may ariise to provide more training to any and all staff 
involved, -which certainly includes anyone assigned to assist in servicing the 
contract at this end. 

As a conclusion to this report, I would like to reiterate that, in spine of a number 
of problems which may have appeared to be major at the time, but generally turned 
out to be relatively minor, the facts of the case as indicated both by demand for 
searches and the evalual:ion detailed above, lead to the conclusion that AEIS and 
SMERC provided a very valuable resource to educators in Arizona and did so in more 
than adequ?/.te manner. 

FRIP" David E. Rawnsley 

June 14, 1973 66 
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FROM: David E» R-ivmsley, Consultant 

San J.'ateo Educational Resources Center 

SUKJFCT: Assessucnt of SMERC Services 



As you kno'.:, the Snu I'^iteo Educc.ticnaL Resources Ce:itcr, through a contract vith the 
Aiizcnp. Zcluccr.ior.n.i ir.r'orr.auion .Systcni, provides searches for clocunients in education 
for Ari^oi-a euucstcrs. Vl vould vary rr.ucin.'i!-e to elicit your cooperation in 
^szer^t^±^2, ihii^ service by asking*, you to fill out the foru below and return it to 
ur- in th.G enclosed £i:volope» Since v;e are using a random sample of those ^;ho have 
ruouesccd .^nd received se .rohes in the past few zionths, it is nosr important to our 
asscsGiuent chat x:e -et - hi^h pei:centa[;e of roziirViS. liir.rcfore, we would be r.;ost 
grateful if you would tahf^ a few minutes and fill oat th? questionnaire as soon as 
possible. 

According to our rcfcord?:, in you requested information on 

and received in reply: microfiche 

photocopies 

coinputer print-out 
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Would ycu answer the follov:inf^ questions about this search (please answer for this 
search only ; if you requested other searches, we would welcome cormc-nts on thoia in 
the "ccMT.ent" section at the end of the questionnaire). We do not expect you to go 
back ^.Ad look at the documents you received. ' Please answer from the best of your 
ir.enory. 

Check the appropriate response. 

RELEVAKCE 1. The material I received was: 

all relevant 

relevant with exception of one or two items 

included only one or two relevant items 

was not relevant 
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UNIQUENESS OF 
INFORMATION 



2. The material I received vas : 
almost ■i;.ll new to me 

divided between new inforaation and information 

I already had available 

not new information 



USE 



3, The material I requested v:as used by; 

myself, for personal and professional growth 

myself, for use in planning, implementing or 

deciding upon some specific activity 

a committee or team 

other (please specify) 



USEFULNESS 



4. The material I received was: 

very useful 

useful, except that 



not very useful because 



TIMING 



5. I received the response to my request: 

about when I expected to receive it 

later than I expected and too late to be useful 

later than I expected, but in tij;ie to be useful 



RESEARCH ASSISTANT 6. 
NOTES 



At the bottoa of the sheet from the Arizona Educational 
Infornation Cystem, u'hich is included with the materials 
sent as the result of a search request, there is 
usually a note from the Research Assistant who did 
the search, explaining the materials included or 
providing other information or comment • In reference 
to your search: v:ould you check the statement below 
which best fits your case. 

there was no note from the Research Assistant 

at the bottom of the sheet 

there nay have been a note at the bottom of the 

sheet, but I didn't notice it 

I read the note, and it was informative about 

the search 

; I read the note, but it didn't tell me much 

about the search 
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BIBLIOGRAPHIES AND ?• Check the statement belox^ which best describes 

RESOURCE GUIDES your case: 

.» 

I have not seen any bibliographies, news notes, 

or resource puides published by the Educational 
Resources Center 

■ I have seen some bibliographies, etc, but have 
not used them 

I have used one or more bibliographies from 

which I ordered documents 



COMMENTS 8. T'Jould you use the space below to make any comments 

about this search or other you may have requested, 
or about the service in general. Thank you again 
for your cooperation. 
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